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ABSTRACT 

Objective To determine tine trade-off between tine 

sensitivity and the specificity for high grade cervical 

intraepithelial neoplasia at hybrid capture 2 cut-off 

values above the standard >1 relative light units/cut-off 

level (rlu/co). 

Design Systematic review. 

Data sources PubMed. 

Study selection Randomised controlled trials in primary 
cervical screening using hybrid capture 2 testing in the 
intervention arms. Articles published until August 2010 
were included if the numbers of women with positive test 
results and with cervical intraepithelial neoplasia were 
stratified by hybrid capture 2 cut-off levels. 
Participants Women in the baseline screening rounds of 
the trials. 

Interventions Hybrid capture 2 screening in the baseline 
round including the diagnostic follow-up as practised in 
the randomised controlled trials and as reported by 
hybrid capture 2 cut-off values. 

Results Owing to heterogeneity in the trials, meta-analysis 
was not possible. Including cut-off values up to SIO rlu/co, 
25 observation points were available for analysis. The 
relative sensitivity for cervical intraepithelial neoplasia 
grade III or higher at cut-off levels of >2, >4 or >5, and 
>10 rlu/co compared with a cut-off level of >1 rlu/co varied 
by trial, but at their lowest they were 0.97, 0.92, and 0.91, 
respectively. A similar pattern was observed for cervical 
intraepithelial neoplasia grade II or higher. The specificity 
would increase by at least 1%, 2%, and 3%, respectively, 
so that up to 24%, 39%, and 53%, of positive hybrid 
capture 2 test results not associated with high grade 
neoplasia could be avoided. Only two outliers existed to 
this general pattern. 

Conclusions Although the data were derived from the 
baseline screening rounds only, the decrease in the 
sensitivity for high grade cervical intraepithelial neoplasia 
using a hybrid capture 2 cut-off level between >2 rlu/co 
and >10 rtu/co seemed acceptable given the 
international recommendations fortesting for human 
papillomavirus DNA in cervical screening, which require 
90% or more sensitivity for cervical intraepithelial 
neoplasia grade II or higher compared with hybrid capture 



2 at ai rlu/co. The data suggest that the hybrid capture 2 
cut-off level could be increased in primary screening; this 
seems reasonably safe and is significantly less 
burdensome for women. 

INTRODUCTION 

The purpose of cervical screening is to decrease the 
burden of cervical cancer. Since the 1960s, cytology 
based cervical screening has led to major reductions 
in the incidence of cervical cancer and related 
mortality.' The method is not highly sensitive, how- 
ever, and several countries, including the United King- 
dom, are considering making the transition to human 
papillomavirus based screening. Although infection 
with high risk human papillomavirus is a necessary 
step in the development of cervical cancer, most infec- 
tions clear spontaneously. Consequently a diagnosis of 
an infection is on its own not adequately specific for 
identification of progressive cervical intraepithelial 
neoplasia.^ This may increase the need for repeated 
testing and the workload for general practitioners and 
gynaecologists. To maximise the benefit of testing for 
human papillomavirus DNA in cervical screening, a 
practical diagnostic algorithm that avoids positive 
human papillomavirus findings in women with no or 
inconsequential cervical intraepithelial neoplasia is 
therefore warranted. 

Hybrid capture 2 (Qiagen, Gaithersburg, Maryland) 
using the threshold of >1 relative light units/cut off 
(rlu/co) is a clinically validated US Food and Drug 
Administration approved test for detection of human 
papillomavirus DNA, with a high sensitivity for high 
grade cervical intraepithelial neoplasia. Compared 
with cytology, hybrid capture 2 has an estimated rela- 
tive sensitivity for detection of cervical intraepithelial 
neoplasia grade III or higher of 1.32 (95% confidence 
interval 1.06 to 1.64).* Hybrid capture 2 detects DNA 
from 13 human papillomavirus genotypes — 16, 18, 31, 
33, 35, 39, 45, 51, 52, 56, 58, 59, and 68— of which 12 
are considered to be high risk for humans and one 
probably carcinogenic.'' Recommendations for screen- 
ing women aged 30 or more use the hybrid capture 
2's levels of sensitivity for cervical intraepithelial 
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neoplasia grade II or higher, its specificity, and its 
reproducibility as a standard to which new tests for 
human papillomavirus DNA should be compared.^ 
To avoid positive hybrid capture 2 test results not asso- 
ciated with neoplasia, several authors have evaluated 
hybrid capture 2 screening strategies with the cut-off 
level for a positive test result above the standard >1 
rlu/co. These authors assessed the trade-offs between 
a decrease in the sensitivity, measured as the detection 
of cervical intraepithelial neoplasia, and an improve- 
ment in the specificity, measured as the test's positive 
predictive value. For example, using the hybrid cap- 
ture 2 with a cut-off level of >1 rlu/co among women 
aged 35 to 60 in the combined Italian phases 1 and 2 
randomised controlled trials, the sensitivity for cervical 
intraepithelial neoplasia grade III or higher was signif- 
icantly increased compared with cytology: relative 
sensitivity 1.52 (95% confidence interval 1.06 to 
2.19). The positive predictive value was significantly 
lower: relative positive predictive value 0.63 (95% con- 
fidence interval 0.44 to 0.89). Using the cut-off level of 
>2 rlu/co, the relative sensitivity was similar, at 1.50 
(1.04 to 2.16), whereas the relative positive predictive 
value increased to 0.81 (0.56 to 1.15).' Similar studies 
have been undertaken, using data from other rando- 
mised controlled trials.** '" 

The studies have not produced a unanimous answer 
on whether and to what extent the cut-off level using the 
hybrid capture 2 could be increased. This may be 
related to several methodological factors. Firstly, some 
studies defined a positive test result as a referral for col- 
poscopy, whereas others accounted for all women 
recommended for follow-up."* These differences in the 
definition of a positive screening test result make a com- 
parison across studies difficult. Secondly, the outcomes 
at increased hybrid capture 2 thresholds were typically 
compared with the outcomes of cytology screening, and 
as the sensitivity of cytology varies among laboratories 
this type of evaluation may not allow a generalised con- 
clusion on the optimal cut-off level using hybrid capture 
2. Finally, several studies observed screening outcomes 
at a single increased hybrid capture 2 cut-off level (for 
example, >2 rlu/ co) ' rather than across a wider range. 
We systematically determined the trade-offs between 
the sensitivity and the specificity for detection of cervi- 
cal intraepithelial neoplasia for hybrid capture 2 at a 
range of increased cut-off levels compared with the stan- 
dard >1 rlu/co. We focused on published data derived 
from baseline screening rounds of the randomised con- 
trolled trials using hybrid capture 2 in primary cervical 
screening because these population based data have 
been in the forefront of the currently ongoing discus- 
sions on the future of cervical screening. In contrast 
with previous studies, we used standard methods to 
ensure that the outcomes could be compared. 

METHODS 

We used PubMed to search for data published until the 
end of August 2010 deriving from randomised con- 
trolled trials using tests for the detection of human 
papillomavirus DNA in primary cervical screening. 



To improve the sensitivity for relevant articles we 
adopted a two step search strategy. The first step was 
used to identify all randomised controlled trials using 
human papillomavirus DNA tests in primary screen- 
ing populations. The second step was used to obtain a 
comprehensive overview of articles published from 
the identified randomised controlled trials. For this 
search we used trial acronyms if these were listed in 
the randomised controlled trial registers," otherwise 
we also searched under the names of the principal 
investigators, contacts for the trial, or heads of organi- 
sations running the trials. " " In both steps we screened 
the retrieved abstracts to identify all potentially rele- 
vant papers, for which we subsequently retrieved full 
text publications. See web extra for the search strate- 
gies for both steps. 

Statistical analysis 

Owing to various differences in the designs of the trials'^ 
we refrained from carrying out a traditional meta-ana- 
lysis and opted for a separate presentation of the results 
from each trial in a structured format. Using a prespeci- 
fied table format (table 1), two researchers indepen- 
dently retrieved the numbers of women included in 
the trials, those with a positive hybrid capture 2 test 
result, and those with histologically diagnosed cervical 
intraepithelial neoplasia grades I, II, and III or higher at 
each reported cut-off level and for each reported age 
group. Information on follow-up procedures and on 
ascertainment of cervical intraepithelial neoplasia was 
also obtained during this process. 

We defined a hybrid capture 2 test result as positive if 
any test was at or above the analysed cut-off level, 
regardless of the subsequent follow-up recommenda- 
tions (immediate colposcopy or repeated testing).^ We 
defined a positive test result not followed by a diagnosis 
of the studied cervical intraepithelial neoplasia as a 
false positive. If followed up properly, these women 
would all have undergone repeated testing or colpo- 
scopy. We calculated, by grade of cervical intra- 
epithelial neoplasia, the detection rates (numbers of 
women with detected neoplasia per 100 000 women), 
the relative sensitivity, the relative specificity, and the 
relative risks of false positive test results at increased 
hybrid capture 2 cut-off levels, using the number of 
women with positive test results and the detection of 
cervical intraepithelial neoplasia at >1 rlu/co as the 
reference values. The 95% confidence intervals were 
calculated by assuming a binomial distribution of the 
studied events. 

RESULTS 

The first step of the search identified 275 articles (fig 1) . 
After screening of the abstracts, 35 full text articles 
were retrieved. Eleven randomised controlled trials 
that used testing for human papillomavirus DNA in 
primary screening were identified this way. Two of the 
trials did not use hybrid capture 2 and one included 
a selected group of women who had not responded to 
previous invitations.^' These three trials were 
excluded from further searches. For the remaining 
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Table 1 1 Randomised controlled trials with hybrid capture 2 based screening: numbers of 
women with positive test results at various cut-off levels, and with detected cervical 
intraepithelial neoplasia grade ill or higher, grade ii, and grade i 



Trial (age range) 


Hybrid capture 
2 cut-off level 
(rlu/co) 


No of women 
with positive 
test result 


Cervical intraepithelial neoplasia grade 
lllorhlgher II 1 




>1 


836 


15 


39 


122 


Italian phase 1 (25-34)" 


>2 


730 


15 


39 


114 


>4 


664 


15 


37 


112 




>10 


575 


14 


35 


101 




>1 


907 


24 


44 


133 


Italian phase 2 (25-34)' 


>2 


796 


24 


43 


121 


>4 


703 


23 


43 


112 




>10 


615 


23 


41 


98 




>1 


3813 


304 


244 


NA 


UK trial (20-64)" 


>2 


3200 


300 


234 


NA 


>4 


2816 


293 


229 


NA 




>10 


2358 


282 


216 


NA 




>1 


1185 


38 


35 


118 


Italian phase 1 (35-60)'** 


>2 


908 


37 


35 


98 


>4 


738 


35 


34 


85 




>10 


572 


35 


33 


65 




>1 


1029 


35 


34 


103 


Italian phase 2 (35-60)' 


>2 


789 


35 


30 


82 


>4 


647 


33 


27 


68 




>10 


533 


29 


22 


54 




>1 


1475 


22 


55 


46 




>2 


1221 


22 


55 


46 




>3 


1110 


22 


55 


44 


Finnish trial (30-60)'° 


>5 


972 


21 


52 


44 


>10 


797 


20 


50 


42 




>50 


500 


18 


44 


31 




>250 


246 


8 


24 


25 




>1000 


84 


5 


17 


0 



NA=not available. 



eight randomised controlled trials, the search in the 
second step retrieved 471 articles (fig 1). The abstracts 
were checked and 34 full text articles were retrieved. 
For three trials, no article was found stratifying the 
number of women with positive screening tests and 
the number of women with detected cervical intra- 
epithelial neoplasia by hybrid capture 2 cut-off level, 
and from one trial these data were not stratified in 
enough detail. "^^^'^ Finally, in five articles from four 
trials the relevant outcomes were reported by hybrid 
capture 2 cut-off level in the baseline round of the inter- 
vention arms: one from Finland, one from the United 
Kingdom," one from Italy (phase 2 trial),' and two 
from Italy (phase 1 trial). ^'^"^ Hybrid capture 2 data 
from the UK trial, however, were stratified in greater 
detail in a publication combining data from the inter- 
vention and control arms (in the control arm of the UK 
trial, the outcome of hybrid capture 2 testing was avail- 
able but concealed for the purpose of the management 
of women), ' * and we used these latter data. In none of 
the trials were data from the subsequent screening 
round stratified by hybrid capture 2 cut-off level. All 
four trials with the relevant data were undertaken 



within established organised screening programmes 
and included previously screened women after an invi- 
tation for screening. Taking into account the observed 
loss to follow-up, ascertainment of diagnoses in women 
with abnormal screening test results was complete in 
all trials except for Finland, where data have not been 
reported by cut-off level for women with a positive 
hybrid capture 2 test result with triage cytology less 
severe than low grade squamous intraepithelial neo- 
plasia. The processes of obtaining reference diagnoses 
varied by study and are summarised in table 2. 

Proportion of women with a positive screening test result 

The numbers of women with a positive test result and 
the numbers of cervical intraepithelial neoplasia grade 
III or higher and grade II or higher could be extracted 
from all trials (table 1). The proportions of positive 
hybrid capture 2 test results varied by trial but were 
consistently lower in trials including only women 
older than 30 (fig 2). The hybrid capture 2 test was 
positive at >1 rlu/co in 7.1% and 5.8% of women in 
the Italian phase 1 and phase 2 trials (35-60 years), 
respectively, and in 8.0% in the Firmish trial 
(30-60 years). The test result was positive in 13.9% of 
women in the Italian phase 1 trial (25-34 years), 13.1% 
in the Italian phase 2 trial (25-34 years), and 15.6% in 
the UK trial (20-64 years). The proportion of women 
with a positive hybrid capture 2 test decreased by 
increased cut-off levels in all trials. 

Relative sensitivity for cervical Intraepithelial neoplasia by 
hybrid capture 2 cut-off level 

At a cut off of >1 rlu/co, the detection rates of cervical 
intraepithelial neoplasia grade III or higher varied 
between 119 and 1240 per 100000 screened women 
(fig 2). Per 100000 women screened the detection 
rates of cervical intraepithelial neoplasia grade II var- 
ied between 192 and 996 and those of cervical intra- 
epithelial neoplasia grade I varied between 249 and 
2033, underlining the variability of the studied popula- 
tions, the subjective nature of cervical intraepithelial 
neoplasia diagnosis, and the variability in the comple- 
teness of reported data. Despite the described inter- 
trial variation in the detection rates of cervical intra- 
epithelial neoplasia grade III or higher and grade II 
or higher, similar relative sensitivities compared with 
a cut-off level >1 rlu/co were observed when the 
threshold was increased (see web extra figure). 
Throughout the range of cut-off levels up to >10 
rlu/co, the relative sensitivities for cervical intra- 
epithelial neoplasia grade III or higher and for grade 
II or higher were consistently at least 90% compared 
with >1 rlu/co in all trials except one (table 3). 

At cut-off level >2 rlu/ co, the relative sensitivity for 
cervical intraepithelial neoplasia grade III or higher in 
the Italian phase 1 trial (35-60 years) was 0.97. The 
relative sensitivity for cervical intraepithelial neoplasia 
grade II or higher in the UK trial was 0.97, and in the 
Italian phase 2 trial (35-60 years) it was 0.94. In all other 
reviewed trials the relative sensitivity for cervical 
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intraepithelial neoplasia grade III or higher and for 
grade II or higher was closer to 1. 

At cut-off level >4 rlu/ co (>5 rlu/ co in the Finnish 
trial), the relative sensitivity for cervical intraepithelial 
neoplasia grade III or higher ranged between 0.92 in 
the Italian phase 1 trial (35-60 years) and 1.00 in the 
Italian phase 1 trial (25-34 years). The relative sensitiv- 
ity for cervical intraepithelial neoplasia grade II or 
higher in the Italian phase 2 trial (35-60 years) was 
0.87. In other trials, the relative sensitivity for cervical 
intraepithelial neoplasia grade II or higher ranged 
between 0.95 (UK, Italian phase 1 (35-60 years), Fin- 
land) and 0.97 (Italian phase 2, 25-34 years). 

At cut-off level >10 rlu/co, the relative sensitivity for 
cervical intraepithelial neoplasia grade III or higher was 
the lowest in the Italian phase 2 trial (35-60 years), at 
0.83. In other trials, the relative sensitivity for cervical 
intraepithelial neoplasia grade III or higher varied 
between 0.91 (Finland) and 0.96 (Italian phase 2, 
25-34 years). The relative sensitivity for cervical intra- 
epithelial neoplasia grade II or higher was again the low- 
est in the Italian phase 2 trial (35-60 years), at 0.74, 
whereas in the other trials it ranged between 0.91 (UK, 
Italian phase 1 (25-34 years), Finland) and 0.94 (Italian 
phase 2, 25-34 years). At higher cut-off levels in the Fin- 
nish trial, the relative sensitivity for any grade of cervical 
intraepithelial neoplasia decreased substantially. 

The relative sensitivity for cervical intraepithelial 
neoplasia grade I tended to be more substantially 
decreased at increased cut-off level, although more so 
in the Italian trials than in the Finnish trial (table 3). At 
cut-off level >4 rlu/co (>5 rlu/co in the Finnish trial), 
the relative sensitivities for cervical intraepithelial neo- 
plasia grade I were 0.92 and 0.84 in the Italian phases 1 
and 2 trials (25-34 years), 0.72 and 0.66 in the Italian 
phases 1 and 2 trials (35-60 years), and 0.96 in the Fin- 
nish trial. At cut-off level >10 rlu/co the relative sensi- 
tivities were 0.83, 0.74, 0.55, 0.52, and 0.91, 
respectively. 

Relative specificity for cervical intraepithelial neoplasia by 
hybrid capture 2 cut-off level 

At all increased cut-off levels, the specificity for cervi- 
cal intraepithelial neoplasia grade III or higher 
increased significantly (table 3, web extra figure). At 
cut-off level >2 rlu/ co, the specificity increased within a 
range of 1% (Italian phase 2 (35-60 years), and Finland) 
and 3% (UK trial). At cut-off level >4 rlu/co (>5 rlu/co 
in Finland), the specificity increased within a range of 
2% (Italian phase 2, 35-60 years) and 5% (UK trial), and 
at cut-off level > 1 0 rlu/ co it increased within a range of 
3% (Italian phase 2, 35-60 years) and 7% (UK trial). 
Similar numbers were found for cervical intraepithelial 
neoplasia grade II or higher as end point. 

These gradual increases in the specificity were 
reflected in the considerably reduced risks of false posi- 
tive hybrid capture 2 test results (fig 3). When cervical 
intraepithelial neoplasia grade III or higher was used as 
an end point, for example, the relative proportions 
compared with >1 rlu/co at cut-off level >10 rlu/co 
were 0.68 and 0.67 in the Italian phases 1 and 2 trials 



(25-34 years), 0.59 in the UK trial, 0.47 and 0.5 1 in the 
Italian phases 1 and 2 trials (35-60 years), and 0.53 in 
the Finnish trial. Similar results were obtained for other 
grades of cervical intraepithelial neoplasia (data not 
shown). 

DISCUSSION 

Recently published international recommendations 
for screening women aged 30 or more for human papil- 
lomavirus require that new tests to detect human papil- 
lomavirus DNA show at least a 90% sensitivity for 
cervical intraepithelial neoplasia grade II or higher 
compared with the sensitivity of hybrid capture 2 test- 
ing using the cut-off level >1 rlu/ co,'' and according to 
Kinney et al, the sensitivity of human papillomavirus 
screening for cervical intraepithelial neoplasia grade 
III or higher should be above 90%.^ Our reanalysis of 
the reported trial data showed that hybrid capture 2 
testing using the range of increased cut-off levels 
between >2 rlu/co and >10 rlu/co is able to meet 

Stepl 

Identification 

Records identified tiirougii I Additional records identified 
database searching (n=275) thiroughi other sources (n=0) 

1 I 1 

Screening 1 

Records after duplicates removed (n=275) I 



Records screened (n=275) 





— ^ Records excluded (n=240) | 


Eligibility 





Full text articles assessed for eligibility (n=35) 







included 


Full text articles excluded (n=8): 
— ^ Hybrid capture 2 not used (2 trials, 7 articles) 
Selected group of women (1 trial, 1 article) 




Studies included in qualitative synthesis (n=27) 

8 randomised controlled trials trials identified; then step 2 



Step 2 

Identification 

Records identified through 1 Additional records identified 

database searching (n=471) through other sources (n=0) 



Screening | 

Records after duplicates removed (n=471) 



Records screened (n=471) 





— ^ Records excluded (n=437) | 


Eligibility 





Full text articles assessed for eligibility (n=34) 









included 




Full text articles excluded (n=29): 
Screening outcomes not reported by hybrid 

capture 2 cut-off level (n=24) 
Screening outcomes not reported by hybrid 

capture 2 cut-off level in enough detail (n=5) 






Studies included in qualitative synthesis 
(meta-analysis) (n=5): not applicable 



Fig 1 1 Study selection 
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Table 2 1 Reported data on follow-up procedures from randomised controlled trials 



Trial 


Acronym 


Age range 
(years) 


No in intervention 
arm 


Follow-up recommendations after positive 
hybrid capture 2 test result (>1 rlu/co) 


Compliance with follow-up 
recommendations 


Reported histology 


Italian piiase l" 


NTCCl 


25-34 


6002 


Cytology normal: repeat testing at 1 2 months; 
atypical squamous cells of undetermined 
significance or worse: colposcopy 


Cytology normal: 62%; atypical 
squamous cells of undetermined 
significance orworse: 94% 


Consensus diagnosis <1 year of 
referral for colposcopy (immediate 
or after repeated testing) 


Italian piiase l" 


NTCC 2 


25-34 


6937 


Colposcopy 


94% 


Consensus diagnosis <1 year of 
referral for colposcopy (immediate 
or after repeated testing) 


UK trial" 


ARTISTIC 


20-64 


24 510* 


Intervention arm: cytology normal: repeat 
testing at 12 months; borderline or mildly 
abnormal: repeat testing at six months; 
moderately abnormal or worse: colposcopy. 
Control arm: borderline or mildly abnormal: 
repeat testing at six months; moderately 
abnormal orworse: colposcopy 


Intervention arm: cytology normal: 
55%. Other: NA 


Worst diagnosis in <30 months of 
abnormal round 1 sample 


Italian phase 1^^ 


NTCC 1 


35-60 


16 706 


Colposcopy 


93% 


Consensus diagnosis 51 year of 
referral for colposcopy (immediate 
or after repeated testing) 


Italian piiase 2^ 


NTCC 2 


35-60 


17 724 


Colposcopy 


93% 


Consensus diagnosis <1 year of 
referral for colposcopy (immediate 
or after repeated testing) 


Finnisii triai'" 


NA 


30-60 


18 438 


Cytology normal or atypical squamous cells of 
undetermined significance: repeat testing at 
12 months; low grade squamous 
intraepithelial lesionsf or worse: colposcopy 


NA 


NA 


NA = not available. 

*lnten/entlon and control arm combined. 

fHistology not reported for women with cytology less severe than low grade squamous intraepithelial lesions. 



these requirements. Using the cut-off level >2 rlu/co 
instead of >1 rlu/ co, up to 3% of cervical intraepithelial 
neoplasia grade II or higher and of grade III or higher 
detectable at cut-off level >1 rlu/co would not be 
detected at the given screen. Up to 8% of cervical intra- 
epithelial neoplasia grade II or higher and of grade III 
or higher would not be detected at the given screen if 
the cut-off levels >4 or >5 rlu/ co were used, and up to 
9% if the cut-off level >10 rlu/co was used. The speci- 
ficity of the hybrid capture 2 test was significantly 
increased with increased cut-off levels, reflecting a sig- 
nificantly reduced risk of false positive test results. At 
cut-off level > 1 0 rlu/ co, this risk was reduced by about 
one half among women aged 30 or more, whereas 
among younger women the reduction was about one 
third. The observed patterns were consistent across 
trials, with the only exception being the Italian phase 
2 trial for women aged 35 to 60. In this trial, 1 7% of the 
cervical intraepithelial neoplasia grade III or higher 
would be missed at cut-off level >10 rlu/co. Owing to 
the relatively low number of cervical intraepithelial 
neoplasia grade II or higher and of grade III or higher 
reported from most trials, the calculated 95% confi- 
dence intervals for relative sensitivities were wide. 

Limitations of the study 

No reported data sufficiently stratified by hybrid 
capture 2 cut-off level could be identified from four ran- 
domised controlled trials, of which two were underta- 
ken in previously unscreened women,^"'' one was not 
undertaken within an organised screening programme,'* 
and one has not yet completed its recruitment.^^ The 
outcomes presented in this systematic review may 
therefore not be generalisable to settings with 



opportunistic screening and settings with previously 
unscreened women. Some of the data from the four 
trials included in this systematic review have been 
incompletely reported. For instance, data on lesions 
detected during the extended follow-up in the two Ita- 
lian trials^'^ have not been reported by baseline cut-off 
levels, and data on lesions detected during follow-up 
with repeated testing of women with triage cytology 
less severe than low grade squamous intraepithelial 
lesions have not been reported by cut-off level from 
the Finnish trial.'*" It could be argued that in the reported 
data from the Finnish trial, the detection of cervical 
intraepithelial neoplasia grade I was particularly low 
because only women positive for human papilloma- 
virus and with at least low grade squamous intra- 
epithelial neoplasia on cytology were referred for 
colposcopy. 

Detection of cervical intraepithelial neoplasia 
depends on the follow-up procedures for women who 
were positive at hybrid capture 2 cut-off level >1 
rlu/co, and these procedures varied by trial (table 2). 
In the Italian phase 2 trial, all of these women were 
immediately referred for colposcopy, whereas in the 
Italian phase 1 trial they were immediately referred 
for colposcopy only if they were older than 34 or had 
abnormal cytology, in the Finnish trial if the cytology 
was low grade squamous intraepithelial neoplasia or 
worse, and in the UK trial if the cytology was at least 
moderately abnormal. In trials with reported data, 
more than 90% of the immediately referred women 
had colposcopy. Women with a positive hybrid cap- 
ture 2 test result not immediately referred for colpo- 
scopy were recommended to undergo repeated 
testing in six to 12 months, and only 55% in the UK 
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Positive iiybrid capture 2 test results/100 women 

Detection of CIN III+/1000 women 

• >1 rlu/co ■ >3 rlu/co A >5 rlu/co T >50 rlu/co O>1000 rlu/co 
0>2 rlu/co □ >4 rlu/co A >10 rlu/co V>250 rlu/co 




Hybrid capture 2 cut-off levels (rlu/co) 

I I I I I I I I I I I I 

Italian Italian UKtrial Italian Italian Finnish trial 

phase 1 phase 2 20-64 phase 1 phase 2 30-60 

25-34 25-34 years 35-60 35-60 years 

years years years years 

Fig 2 1 Percentage of women with positive hybrid capture 2 test results, and detection rates of 
cervical intraepithelial neoplasia grade III or higher (CIN 111+) per 1000 women screened, by 
hybrid capture 2 cut-off level in intervention arms of reviewed randomised controlled trials 
(intervention+control arm in UK trial) 

trial and 62% in the Italian phase 1 trial had the 
repeated test and a colposcopy if the repeated test 
result was positive. Despite this variability in the fol- 
low-up strategies across trials, the trade-offs between 
the indicators of sensitivity and specificity at increased 
hybrid capture 2 cut-off levels were similar. 

It should be taken into account that women in the 
intervention arms of the trials were predominantly man- 
aged according to the hybrid capture 2 cut-off level >1 
rlu/co. Thus, these data did not allow for a direct com- 
parison of the long term negative predictive values at 
different cut-off levels. The excellent negative predic- 
tive values found at cut-olf level >1 rlu/co suggested 
that the screening intervals could be extended from 
the current three to five years with cytology to 6 to 7. 
5 years using human papOlomavinis DNA testing.""^^ 
Theoretically, increasing the cut-off level may not 
allow precisely the same extension of the screening 
interval. Many cervical intraepithelial neoplasia grades 
III and II though do not progress to cervical cancer. 
When they do, the progression is gradual and on aver- 
age takes more than 10 years.'^"* The increased cut-off 
level is therefore not expected to substantially decrease 
the effectiveness of hybrid capture 2. Similar precaution 
needs to be taken when the sensitivity of new human 
papUlomavirus DNA tests will be compared with 
hybrid capture 2 using the published guidelines.'' 

Other studies 

Screening outcomes stratified by hybrid capture 2 cut- 
off level have been reported also from several split 
sample studies in which women were screened with 
both hybrid capture 2 and cytology. In general, these 
studies corroborated the findings from the randomised 
controlled trials. For example, among the 10358 
women aged 30 to 60 in the HART study, 67 had a 
diagnosis of cervical intraepithelial neoplasia grade 



III or higher after a positive hybrid capture 2 test result 
using the cut-off level >1 rlu/co. In 93% of these 67 
women (62/67; 95% confidence interval 83% to 
98%), the hybrid capture 2 test result was positive at 
>10 rlu/co. At this cut-off level, 40% fewer women 
had a false positive test result compared with a cut-off 
level >1 rlu/co (428/717; 37% to 44%)."'^ In a French 
study of 7932 females screened aged 15 to 76, 96% of 
cervical intraepithelial neoplasia grade II or higher was 
detected with a hybrid capture 2 cut-off level >3 rlu/ co 
(124/129; 91% to 99%), although at the cut-off level 
>10 rlu/co this proportion decreased to 88% (114/ 
129; 82% to 93%).-^' In 1999 Finnish females aged 15 
to 86 referred for various gynaecological disorders, the 
relative sensitivity for cervical intraepithelial neoplasia 
grade III or higher was 0.86 (19/22; 0.65 to 0.97) and 
for grade II or higher it was 0.93 (42/45; 0.82 to 0.99) at 
a cut-off level >5 rlu/ co compared with >1 rlu/ co.""^ 

Among 905 7 previously unscreened women aged 30 
to 54 in rural China, 134 had a diagnosis of cervical 
intraepithelial neoplasia grade III or higher associated 
with a hybrid capture 2 positive test result at cut-off 
level >1 rlu/ co and 125 at cut-off level >10 rlu/ co (rela- 
tive sensitivity 0.93, 95% confidence interval 0.88 to 
0.97). Although the relative sensitivity was slightly 
decreased (0.88) when adjustment was applied to 
account for the differences among the participating 
centres and verification bias, the authors concluded 
that using hybrid capture 2 testing with a cut-off level 
>10 rlu/co "might be the most appropriate" screening 
strategy for areas with basic screening infrastructure 
that does not allow frequent screening.'*'' 

Recently, detailed results for a range of hybrid cap- 
ture 2 cut-off levels were presented from a Dutch 
VUSA-screen cohort study of 25 871 women aged 30 
to 60 screened with both hybrid capture 2 and 
cytology.*" In this study, the relative sensitivity for 
high grade cervical intraepithelial neoplasia and the 
relative risks of false positive test results with increased 
hybrid capture 2 cut-off levels were compared with the 
outcomes of cytology screening. Only women referred 
for colposcopy were taken into account in the calcula- 
tion of the risk of false positive test results. This study 
could not identify any increased hybrid capture 2 cut- 
off level at which the colposcopy referral rate would be 
similar to that in cytology screening without at the 
same time substantially decreasing the test's sensitivity 
for high grade cervical intraepithelial neoplasia. The 
authors consequently proposed to keep the >1 rlu/co 
cut-off level. We recalculated the VUSA-screen data 
using the hybrid capture 2 test with a cut-off level >1 
rlu/co as a reference, and accounting for all positive 
screening test results in the calculation. At a cut-off 
level >10 rlu/co, the relative sensitivity for cervical 
intraepithelial neoplasia grade III or higher was 0.90 
(131/146; 95% confidence interval 0.84 to 0.94) com- 
pared with cut-off level >1 rlu/co, and the correspond- 
ing relative risk of false positive test results was 0.64 
(746/1157; 0.62 to 0.67). The relative sensitivity for 
cervical intraepithelial neoplasia grade II or higher 
was 0.89 (203/227; 0.85 to 0.93) and the corresponding 
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Table 3 1 Relative sensitivity, relative specificity, and relative risl<s of false positive test results, by hybrid capture 2 cut-off level 







Cervical intraepithelial neoplasia 
grade III or higher 


Cervical intraepithelial neoplasia 
grade II or higher 


Cervical 
intraepithelial 
neoplasia grade 1 




Hybrid capture 2 

n if-nff lo\/ol frill /rn\ 


Relative sensitivity 
(95% CI) 


Relative specificity 
(95% CI) 


IxcldLIVc 1 I3t\ Ul 

false-positive tests 
(95% CI) 


Relative sensitivity 
(95% CI) 


Relative specificity 
(95% CI) 


Relative sensitivity 
eg CO/ rn 




>2 


1 


1 


1 


1 


1 




Italian phase 1 


>2 


1.00 (0.78 to 1.00) 


1.02 (1.02 to 1.02) 


0.87 (0.85 to 0.89) 


1.00(0.93 to 1.00) 


1.02 (1.02 to 1.02) 


U.y3 yu.o/ lu v.y/ J 




>^ 


1.00 (0.78 to 1.00) 


1.03 (1.03 tol.04) 


0.79(0.76 to 0.82) 


0.96(0.87 to 1.00) 


1.03 (1.03 to 1.04) 


n oi rn tn n of^^ 
u.?z ^u.oD lU KJ.yoj 






0.93 (0.68 to 1.00) 


1.05 (1.04 to 1.06) 


0.68 (0.65 to 0.72) 


0.91 (0.80 to 0.97) 


1.05 (1.04 to 1.06) 


n rn 7^ tn n siQ\ 






1 


1 


1 


1 


1 


1 


Italian phase 2 


>2 


1.00 (0.88 to 1.00) 


1.02 (1.02 to 1.02) 


0.87 (0.85 to 0.90) 


0.99(0.92 to 1.00) 


1.02 (1.01 to 1.02) 


n Q1 rn Ri^ tn n oo 




^4 


0.96 (0.79 to 1.00) 


1.03 (1.03 to 1.04) 


0.77 (0.74 to 0.80) 


0.97(0.90 to 1.00) 


1.03 (1.03 to 1.04) 


n Q/i rn 77 tn Ci Of\\ 






0.96 (0.79 to 1.00) 


1.05 (1.04 to 1.05) 


0.67 (0.64 to 0.70) 


0.94 (0.86 to 0.98) 


1.05 (1.04 to 1.05) 


n 7/i rn f^c; tn n si^ 






1 


1 


1 


1 


1 


MA 
IN A 


UK trial 


^2 


0.99 (0.97 to 1.00) 


1.03 (1.03 to 1.03) 


0.83 (0.81 to 0.84) 


0.97 (0.96 to 0.99) 


1.03 (1.03 to 1.03) 


MA 
IN A 


(20-64) 


>^ 


0.96 (0.94 to 0.98) 


1.05 (1.04 to 1.05) 


0.72 (0.70 to 0.73) 


0.95 (0.93 to 0.97) 


1.05 (1.04 to 1.05) 


NA 






0.93 (0.89 to 0.95) 


1.07 (1.07 to 1.07) 


0.59 (0.58 to 0.61) 


0.91 (0.88 to 0.93) 


1.07 (1.06 to 1.07) 


NA 




>^ 


1 


1 


1 


1 


1 




Italian phase 1 


^2 


0.97 (0.86 to 1.00) 


1.02 (1.02 to 1.02) 


0.76 (0.73 to 0.78) 


0.99(0.93 to 1.00) 


1.02 (1.02 to 1.02) 


n Q-^ rn 71^ tn Ci QQ^ 
U.03 \\J./ D 10 V.Qyj 


(35-60) 


>^ 


0.92 (0.79 to 0.98) 


1.03(1.03 to 1.03) 


0.61 (0.58 to 0.64) 


0.95 (0.87 to 0.98) 


1.03 (1.03 to 1.03) 


n 71 rn tn n siri\ 

U./ Z yU.OJ lU V.OVj 






0.92 (0.79 to 0.98) 


1.04 (1.04 to 1.04) 


0.47 (0.44 to 0.50) 


0.93 (0.85 to 0.98) 


1.04 (1.04 tol.04) 


n 1^1^ rn At^ tn Ci 




>^ 


1 


1 


1 


1 


1 




Italian phase 2 


^2 


1.00 (0.90 to 1.00) 


1.01 (1.01 to 1.02) 


0.76(0.73 to 0.78) 


0.94 (0.86 to 0.98) 


1.01 (1.01 to 1.02) 


n on rn 71 tn n Q7^ 


(35-60) 


>^ 


0.94 (0.81 to 0.99) 


1.02 (1.02 to 1.03) 


0.62 (0.59 to 0.65) 


0.87(0.77 to 0.94) 


1.02 (1.02 to 1.02) 


n rn tn n 71;^ 

U.OU lU U./ DJ 






0.83 (0.66 to 0.93) 


1.03 (1.03 to 1.03) 


0.51 (0.48 to 0.54) 


0.74 (0.62 to 0.84) 


1.03 (1.03 to 1.03) 


n rn /i -J tn n ^^')^ 




>^ 


1 


1 


1 


1 


1 






>2 


1.00 (0.85 to 1.00) 


1.01 (1.01 to 1.02) 


0.83 (0.80 to 0.84) 


1.00 (0.95 to 1.00) 


1.01 (1.01 to 1.02) 


1.00 (0.92 to 1.00) 




>3 


1.00 (0.85 to 1.00) 


1.02 (1.02 to 1.02) 


0.75 (0.73 to 0.77) 


1.00 (0.95 to 1.00) 


1.02 (1.02 to 1.02) 


0.96 (0.85 to 0.99) 


Finnish trial 


>5 


0.95 (0.77 to 1.00) 


1.03 (1.03 to 1.03) 


0.65 (0.63 to 0.68) 


0.95 (0.87 to 0.99) 


1.03 (1.03 to 1.03) 


0.96 (0.85 to 0.99) 


(30-60) 


>10 


0.91 (0.71 to 0.99) 


1.04 (1.04 to 1.04) 


0.53 (0.51 to 0.56) 


0.91 (0.82 to 0.96) 


1.04 (1.04 to 1.04) 


0.91 (0.79 to 0.98) 




>50 


0.82 (0.60 to 0.95) 


1.06 (1.05 to 1.06) 


0.33 (0.31 to 0.36) 


0.81 (0.70 to 0.89) 


1.06 (1.05 to 1.06) 


0.67 (0.52 to 0.80) 




>250 


0.36 (0.17 to 0.59) 


1.07 (1.07 to 1.08) 


0.16 (0.15 to 0.18) 


0.42 (0.30 to 0.53) 


1.07 (1.07 to 1.07) 


0.54 (0.39 to 0.69) 




>1000 


0.23 (0.08 to 0.45) 


1.08 (1.08 to 1.09) 


0.05 (0.04 to 0.07) 


0.29 (0.19 to 0.40) 


1.08 (1.07 to 1.08) 


0.00 (0.00 to 0.08) 



NA=not available. 



relative risk of false positive test results was 0.63 (674/ 
1076; 0.60 to 0.65). Thus, the VUSA-screen data were 
in line with the data from the analysed randomised 
controlled trials, and in fact support using an increased 
hybrid capture 2 cut-off level in screening. 

Effect on cervical intraepithelial neoplasia treatment and 
the psychosocial burden of screening 

If the cut-off level was increased from>l rlu/co to >10 
rlu/co, up to 18 fewer women with cervical intra- 
epithelial neoplasia grade III or higher per 100000 
screened women would be diagnosed and treated at 
the given screen in part of the Italian trials and in the 
Finnish trials. This number was 34 in the Italian phase 2 
trial (35-60 years) and 90 in the UK trial, although in 
the case of the UK trial this still represented less than 
10% of all detected cervical intraepithelial neoplasia 
grade III or higher at >1 rlu/co. The rare prevalent 
cancer cases at a given screening round may, however, 
be at risk of being missed at any cut-off point. " 

Even in women over 30, the use of human papillo- 
mavirus DNA tests would in many countries double 
the number of women with a positive screening test 



result compared with cytology.'**^"^** To help manage 
this increase, several authors have focused on finding 
optimal triage procedures to avoid excess referral for 
colposcopy and excess diagnoses, particularly of cervi- 
cal intraepithelial neoplasia grade 11.'^''^ This is war- 
ranted, as colposcopy tends to be relatively expensive 
and induces anxiety.*'' Furthermore, cervical intra- 
epithelial neoplasia grade II is often regressive'" ''' but 
nevertheless usually recommended for treatment that 
may be associated with severe obstetric outcomes.*^ 
Women with positive human papillomavirus test 
results who are not immediately referred for colpo- 
scopy are normally recommended for repeated testing. 
These repeated tests increase the workload of general 
practitioners or gynaecologists and affect women's 
quality of life.''' The need for repeated tests could 
be substantially decreased by using an increased cut- 
off point. The risk of not detecting a small proportion of 
cervical intraepithelial neoplasia grade III at a given 
screening round should thus be interpreted in the 
light of substantially diminished overdetection of 
harmless human papillomavirus infections in healthy 
women. The frequency of such infections can be well 
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Fig 3 1 Relative sensitivity and relative risl< of false positive 
hybrid capture 2 test results using cervical intraepithelial 
neoplasia grade Ml or higher (CIN 111+) as end point. 
Comparison of increased hybrid capture 2 thresholds with 
standard cut-off level si rlu/co 



illustrated with the data from this review. Per 100000 
screened women, about 1500 fewer healthy women 
would have a false positive test result on screening 
using hybrid capture 2 and remain in follow-up at cut- 
off level >2 rlu/co compared with the cut-off level >1 
rlu/co. Likewise, about 3000 and 4000 fewer healthy 
women would have a false positive hybrid capture 2 
test result if the cut-off level was increased to >4 (>5) 
rlu/co and >10 rlu/co, respectively. These numbers 
were consistent across the reported trial data. In most 
settings, treatment of cervical intraepithelial neoplasia 
grade I is not recommended,™ and another benefit of 
an increased cut-off level for the hybrid capture 2 test is 
therefore the reduced detection of cervical intra- 
epithelial neoplasia grade I. Using the cut-off level 
>10 rlu/co in both Italian trials, for example, cervical 
intraepithelial neoplasia grade I diagnoses could be 
avoided in at least 300 per 100 000 screened women. 



WHAT IS ALREADY KNOWN ON THIS TOPIC 

Human papillomavirus DNA testing seems to be more sensitive for detection of high grade 
cervical Intraepithelial neoplasia than cytology, but It leads to more positive test results not 
associated with neoplasia 

Hybrid capture 2 with a recommended cut-off value of >1 rlu/co Is a clinically validated US 
Food and Drug Administration approved human papillomavirus DNA test 

Most of the high grade cervical Intraepithelial neoplasia lesions show hybrid capture 2 cut-off 
values above >1 rlu/co 

WHAT THIS STUDY ADDS 

If the hybrid capture 2 cut-off level was Increased from the standard >1 rlu/co to >10 rlu/co, 
the number of positive test results without underlying high grade cervical Intraepithelial 
neoplasia would be about halved in women aged 30 years or more 

The results suggest that It may be possible to Increase the cut-off point used for the hybrid 
capture 2 test in screening without jeopardising Its sensitivity for high grade cervical 
intraepithelial neoplasia, but considerably Improving its specificity 



Conclusion 

Increasing the cut-off level for a positive hybrid capture 
2 test result above the standard >1 rlu/co is associated 
with a risk of not detecting some high grade cervical 
intraepithelial neoplasia as early as it would otherwise 
have been possible. The trade-offs between decreased 
sensitivity and increased specificity resulting from 
increasing the hybrid capture 2 cut-off level, however, 
seem acceptable according to the recent international 
recommendations on human papillomavirus DNA 
testing, and both younger and older women would ben- 
efit from this change. In the reported data from most 
reviewed trials, the relative sensitivity at increased cut- 
off levels for cervical intraepithelial neoplasia grade II 
or higher and for grade III or higher would still be 90% 
or more compared with >1 rlu/co. This was the case 
even when the hybrid capture 2 cut-off level was 
increased to >10 rlu/ co. At this level, the improvement 
in the specificity led to about half as many women aged 
30 or more and about one third fewer younger women 
with a false positive hybrid capture 2 test result com- 
pared with the standard cut-off level. 
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